Asymptotic  Controllability  and  Input-to-State 
Stabilization:  The  Effect  of  Actuator  Errors* 


Michael  Malisoff  1  and  Eduardo  Sontag  2 

1  Department  of  Mathematics,  Louisiana  State  University  and  A.  &  M.  College, 
Baton  Rouge  LA  70803-4918,  USA.  malisoff@lsu.edu 

2  Department  of  Mathematics,  Rutgers  University,  New  Brunswick  NJ  08901, 
USA.  sontag@control.rutgers.edu 

Summary.  We  discuss  several  issues  related  to  the  stabilizability  of  nonlinear  sys¬ 
tems.  For  a  given  continuously  stabilizable  system,  we  review  some  constructions 
of  feedbacks  that  render  the  system  input-to-state  stable  with  respect  to  actuator 
errors.  We  also  announce  a  new  feedback  design  that  makes  globally  asymptotically 
controllable  systems  input-to-state  stable  to  actuator  errors  and  small  observation 
noise.  We  illustrate  our  constructions  using  the  nonholonomic  integrator,  and  we 
discuss  a  related  feedback  design  for  systems  with  disturbances. 


1  Introduction 

The  theory  of  input-to-state  stable  (ISS)  systems  forms  the  basis  for  much 
modern  nonlinear  feedback  design  and  analysis  (cf.  [9,  10,  11,  12,  14,  26]). 
In  this  survey,  we  deal  with  several  issues  related  to  the  input-to-state  stabi¬ 
lizability  of  nonlinear  finite-dimensional  continuous-time  control  systems.  We 
focus  on  some  relatively  new  feedback  designs  for  asymptotically  controllable 
systems  that  render  the  corresponding  closed-loop  systems  ISS  with  respect 
to  actuator  errors.  We  cover  the  following  topics: 

1.  Basic  controllability  and  stability  concepts 

2.  Continuously  stabilizable  systems  with  actuator  errors 

3.  Asymptotic  controllability  implies  input-to-state  stabilization 

4.  Feedback  stabilization  of  the  nonholonomic  integrator 

5.  Systems  with  large  observation  noise 

6.  Integral-input-to-state  stabilization 

One  of  our  main  tools  will  be  the  existence  theory  for  smooth  control- 
Lyapunov  functions  (CLF’s)  for  continuously  stabilizable  systems.  We  also 
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use  a  recent  extension  of  this  theory  that  provides  semiconcave  CLF’s  for 
systems  which  are  merely  asymptotically  controllable.  Our  emphasis  will  be 
on  relatively  new  areas  of  research,  including  the  integral-input-to-state  sta¬ 
bilization  of  systems  with  disturbances  (cf.  [1,  13]).  While  our  discussion  will 
be  mainly  conceptual,  we  will  refer  the  reader  to  the  relevant  literature,  where 
detailed  statements  and  proofs  of  all  our  results  are  found.  For  a  survey 
on  the  underlying  theory  of  CLF’s,  stability,  and  stabilization,  see  [25].  As 
a  general  reference,  we  refer  the  reader  to  the  second  author’s  preprints  at 
http : //www .math.rutgers . edu/~  sontag/ papers .html. 


2  Basic  Controllability  and  Stability  Concepts 

In  much  of  what  follows,  we  deal  with  a  general  nonlinear  finite-dimensional 
continuous-time  deterministic  system  of  the  form 

x  =  f(x,u)  (1) 

evolving  over  Euclidean  space,  where  x(t)  £  IR"  for  all  t  >  0  and  the  controls 
u  (which  are  also  called  inputs)  are  measurable  essentially  bounded  functions 
u  :  [0,  oo )  — >  U  =  IRm  taking  their  values  in  the  control  set  U  which  we  have 
taken  to  be  lRm.  We  denote  the  set  of  all  inputs  for  (1)  by  A4m.  When  we 
wish  to  restrict  the  size  of  controls  u  £  A4m  in  the  essential  supremum  |  •  loo, 
we  will  also  use  the  sets  Mf)  =  {it  €  Mm  :  |u|oo  <  N},  defined  for  each 
N  >  0.  Many  of  our  results  easily  generalize  to  locally  essentially  bounded 
inputs  mapping  into  more  general  control  sets  U  C  IRm.  When  we  refer  to 
(1),  we  always  assume  that  /  is  locally  Lipschitz  and  that  /( 0,0)  =  0.  We 
also  study  systems  with  no  inputs 


x  =  f(x)  (2) 

for  continuous  /;  all  definitions  for  such  systems  are  implicitly  applied  to  (1) 
by  setting  u  =  0,  e.g.,  we  define  global  asymptotic  stability  (GAS)  for  (2),  but 
we  say  (1)  is  GAS  if  the  corresponding  zero-input  system  x  =  f(x,  0)  is  GAS. 

We  denote  the  solution  of  (1)  starting  at  any  initial  state  xa  for  any  given 
control  u  £  Mm,  defined  on  its  maximal  interval,  by  x(-,x0,u).  We  let  |  •  | 
denote  the  Euclidean  norm,  and  we  set  rBk  '■=  {x  £  lRfc  :  |x|  <  r}  for  each 
k  £  IN  and  r  >  0.  We  denote  the  closure  of  rBk  by  rBk •  When  we  say  that 
a  function  is  smooth,  we  mean  that  it  is  C 1  (i.e.,  continuously  differentiable). 
We  call  a  function  a  :  IRfc  — »  [0,  oo)  proper  (a.k.a.  radially  unbounded)  if 
a[x)  — »  +oo  as  |x|  — >  +oo.  We  say  that  a  function  a  :  ]Rfc  — >  [0,  oo)  is  positive 
definite  provided  a(x)  =  0  iff  x  =  0. 

We  will  frequently  use  the  following  types  of  comparison  functions.  We  let 
/Coc  denote  the  set  of  all  continuous  functions  p  :  [0,oo)  — »  [0,  oo)  for  which 
(i)  p(0)  =  0  and  (ii)  p  is  strictly  increasing  and  unbounded.  Also,  we  let  ICC 
denote  the  set  of  all  continuous  functions  f3  :  [0,  oo)  x  [0,  oo)  — >  [0,oo)  for 
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which  (1)  €  /Coo  for  each  /  >  0,  (2)  /3(s,-)  is  nonincreasing  for  each 

s  >  0,  and  (3)  /3(s,  t)  — >  0  as  t,  — >  +oo  for  each  s  >  0.  We  also  use  J\f  to  denote 
the  set  of  all  nondecreasing  functions  a  :  [0,  oo)  — >  [0,  oo). 

In  terms  of  comparison  functions,  the  property  of  global  asymptotic  stability 
(GAS)  of  the  system  (2)  without  inputs  is  as  follows: 

(3 /3g/C£)  \x(t)\  <  (3(\x0\,t) 

for  all  xa  G  IR",  all  trajectories  x(-)  of  the  system  (2)  starting  at  x0,  and 
all  t  >  0.  More  generally,  we  say  that  the  system  (1)  with  inputs  is  globally 
asymptotically  controllable  (GAC)  provided: 

(3/3  G  ICC)  (3a  G  A/")  Mx0  G  1R",  3«(-) 

Moo  <  cr(|a;0|),  \x(t,x0,u)\  <  0(\xo\,t)  Vf  >  0. 

Roughly  speaking,  our  definition  of  GAC  amounts  to  requiring  that  for  each 
initial  state,  there  exists  a  control  such  that  the  corresponding  solution  is 
defined  on  [0,  oo)  and  converges  to  zero  with  ‘small  overshoot’  and  also  that 
the  input  remains  bounded  for  x  near  zero. 

The  notion  of  input-to-state  stable  (ISS)  systems  provides  an  alternative 
generalization  of  GAS,  in  which  all  trajectories  of  (1)  converge  to  zero  with 
an  overshoot  depending  on  the  sup  norm  of  the  input.  The  ISS  property  was 
introduced  in  [20],  and  has  become  a  fundamental  concept  on  which  much 
modern  nonlinear  feedback  analysis  and  design  are  based  (cf.  [9,  10,  11,  12, 
14]).  By  definition,  a  dynamics  x  =  f(x,  u)  is  ISS  (with  respect  to  u)  provided 

(3/3  G  ICC)  (37  G  /Coo)  |z(i)|  </3(|z0|,/)  +  7(Moc)  (3) 

for  all  x0  G  IRn,  all  u  G  Mm,  all  trajectories  x(-)  of  the  dynamics  for  u  starting 
at  xa,  and  all  t  >  0.  In  much  of  what  follows,  we  will  be  studying  systems 

x  =  f(x,K(x)  +  u)  (4) 

where  K  is  a  specified  feedback  map  for  (1)  and  the  input  u  G  A4m  repre¬ 
sents  an  actuator  error.  By  a  (memoryless  state)  feedback ,  we  mean  a  locally 
bounded  function  K  :  IR™  — >  U  satisfying  I\( 0)  =  0.  For  the  special  case  of 
the  dynamics  (4)  and  continuous  K,  the  ISS  property  (3)  implies  that  AT  is  a 
stabilizing  feedback  (meaning  that  the  closed-loop  system  x  =  f(x,K(x))  is 
GAS)  and  also  that  the  perturbed  system  (4)  exhibits  bounded  behavior  for 
arbitrary  (essentially)  bounded  actuator  errors  u  G  A4m  (but  see  also  §4  for 
the  definition  of  trajectories  for  ISS  systems  with  discontinuous  controllers). 
We  say  that  (1)  is  input-to-state  stabilizable  (a.k.a.  ISSable)  provided  there 
exists  a  feedback  I\  such  that  (4)  is  ISS.  We  say  that  (1)  is  continuously  sta¬ 
bilizable  (a.k.a.  C°- stabilizable)  provided  there  exists  a  continuous  feedback  K 
such  that  x  =  f(x,K(x))  is  GAS.  Clearly,  C°-stabilizable  systems  are  GAC, 
but  not  conversely  (cf.  §§4-5). 

In  general,  saying  that  a  continuous  dynamics  x  =  f(x,u)  is  ISS  implies 
that  the  corresponding  zero-input  system  x  =  f(x,  0)  is  GAS.  This  suggests 
the  following  natural  question: 
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Question  1.  If  (1)  is  C°-stabilizable,  is  it  also  ISSable? 

We  will  address  this  question  in  §3.  More  generally,  it  is  natural  to  ask: 
Question  2.  If  (1)  is  GAC,  is  it  also  ISSable? 

We  will  address  Question  2  in  §4.  We  will  see  that  the  answers  to  these  ques¬ 
tions  are  yes,  provided  the  given  system  (1)  is  control-affine,  i.e. ,  if  it  has  the 
form  x  =  h(x)  +  G(x)u.  For  the  general  fully  nonlinear  system  (1),  we  will  see 
that  the  answers  to  these  questions  are  still  yes  if  the  system  is  transformed 
using  a  feedback  equivalence  (cf.  §3  for  the  relevant  definitions). 

However,  if  the  system  is  merely  GAC,  then  there  may  be  obstructions  to 
continuous  feedback  stabilization  (cf.  [3,  14,  25]).  Therefore,  we  will  need  to 
allow  discontinuous  feedbacks.  This  produces  the  technical  problem  of  defining 
precisely  what  is  meant  by  a  solution  of  the  dynamics  when  x  =  f(x ,  K(x)+u) 
is  not  continuous,  since  the  standard  Caratheodory  existence  theorems  for 
solutions  would  not  apply.  We  will  resolve  this  problem  by  interpreting  the 
trajectories  of  (4)  for  discontinuous  K  as  Euler  solutions.  The  preceding  issues 
are  central  to  the  rest  of  this  survey. 


3  C°-Stabilizable  Systems  with  Actuator  Errors 

In  this  section,  we  review  the  main  results  from  [20,  22]  on  the  input-to¬ 
st  ate  stabilizability  of  the  system  (1).  Throughout  this  section,  we  assume  the 
system  (1)  is  continuously  stabilizable  (i.e.,  C^-stabilizable),  meaning,  there 
exists  a  continuous  feedback  K\  for  which 

x  =  f(x,Kx{xj)  (5) 

is  GAS.  We  wish  to  design  a  continuous  feedback  function  K  (which  we  allow 
to  be  different  from  the  feedback  used  in  (5))  rendering  the  perturbed  system 
x  =  f(x,K(x)  +  u )  ISS  with  respect  to  the  actuator  error  u.  This  design 
problem  plays  an  important  role  in  control  applications,  where  one  wishes  to 
have  a  feedback  that  is  robust  to  noise  in  the  input  channel. 

For  a  fully  nonlinear  system,  such  a  feedback  fails  to  exist  in  general.  For 
example,  consider  the  scalar  system  x  =  —x  +  x2u2.  By  considering  closed- 
loop  trajectories  starting  at  xa  =  4  for  the  input  u  =  1  (cf.  [22]),  one  can  check 
that  there  is  no  continuous  feedback  K  for  which  the  closed-loop  system 

x  =  —  x  +  x2(K(x)  +  u)2  (6) 

is  ISS,  even  though  x  =  —x  is  obviously  GAS  (i.e.,  using  K\{x)  =  0  as  the 
stabilizer  in  (5)).  In  fact,  if  we  interpret  the  trajectories  of  (6)  in  the  more 
general  sense  of  sampling  and  Euler  solutions  (cf.  §4  for  the  definitions),  then 
one  can  show  that  there  is  no  discontinuous  feedback  rendering  (6)  ISS  either. 
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On  the  other  hand,  if  we  assume  the  given  system  (1)  has  the  control-affine 
form 

x  =  h(x)  +  G(x)u,  (7) 

then  we  have  the  following  positive  result  shown  in  [20]: 

Theorem  1.  If  (7)  is  C° -stabilizable,  then  there  exists  a  continuous  feedback 
I<  :  IR"  ->  ]Rm  for  which 

x  =  h(x)  +  G{x){K{x)  +  u)  (8) 

is  ISS. 

Theorem  1  follows  by  choosing  K(x)  =  Kt  (x)  —  W(x)G(x),  where  V  is  a 
C 1  control-Lyapunov  function  (CLF)  for  (7)  and  K\  is  a  continuous  feedback 
rendering  (7)  GAS.  The  existence  of  such  a  CLF  was  established  in  [2].  (See 
also  [17,  18]  for  the  existence  of  semiconcave  CLF’s  for  GAC  systems,  and  [25] 
or  §4  below  for  the  definition  of  CLF’s,  in  terms  of  set-valued  differentials.) 

While  the  example  (6)  illustrates  that  C’-stabilizability  does  not  in  gen¬ 
eral  imply  input-to-state  stabilizability,  we  can  still  extend  Theorem  1  to  fully 
nonlinear  systems  by  using  the  following  weaker  notion  of  ISS  that  was  intro¬ 
duced  in  [22]:  We  say  that  the  system  (1)  is  ISSable  in  the  weak  sense  (a.k.a. 
weak  ISSable)  provided  there  exist  a  continuous  feedback  K ,  and  an  m  x  m 
matrix  0  of  continuously  differentiable  functions  which  is  invertible  at  each 
point,  such  that  x  =  f(x,K(x)  +  0{x)u)  is  ISS.  We  then  have  the  following 
extension  of  Theorem  1  for  fully  nonlinear  systems  shown  in  [22] : 

Theorem  2 .  If  (1)  is  C°  -stabilizable,  then  it  is  ISSable  in  the  weak  sense. 

Theorem  2  can  be  restated  in  terms  of  feedback  equivalence,  as  follows.  Re¬ 
call  that  two  systems  x  =  f(x,u )  and  x  =  f(x,u)  evolving  on  IR"  x  IRm 
are  said  to  be  feedback  equivalent  provided  that  there  exist  a  feedback 
I\  :  IR"  — >  JRm  and  an  everywhere  invertible  function  0  :  IR"  — >  IRmxm 
for  which  f(x,u)  =  f(x,K(x)  +  0(x)u)  for  all  x  €  IR"  and  u  £  lRm;  the 
systems  are  said  to  be  continuously  feedback  equivalent  if,  in  addition,  K  can 
be  taken  to  be  continuous.  (See  also  [24]  for  a  more  general  definition  of  feed¬ 
back  equivalence,  also  involving  a  diffeomorphic  transformation  of  the  state 
variable.)  The  following  is  then  a  direct  consequence  of  Theorem  2: 

Corollary  1.  The  fully  nonlinear  control  system  (1)  is  C° -stabilizable  if  and 
only  if  it  is  continuously  feedback  equivalent  to  an  ISS  system. 

See  also  [5,  7]  for  a  construction  of  time-varying  ISS  stabilizing  feedback. 


4  Asymptotic  Controllability  Implies  ISS  Stabilization 

In  the  preceding  section,  we  saw  how  C°-stabilizable  systems  can  be  stabi¬ 
lized  with  respect  to  actuator  errors.  However,  in  many  engineering  applica¬ 
tions,  the  given  system  is  not  C°-stabilizable.  For  example,  if  to  <  n  and  if 
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rank[(/i(0), 52(0), . . .  ,gm(0)]  =  m,  then  it  is  impossible  to  continuously  stabi¬ 
lize  the  drift-free  system  x  =  U\g\(x)  +  . .  .+umgm(x),  x  £  IR";  thus,  no  totally 
nonholonomic  mechanical  system  is  C’-stabilizable  (cf.  [25],  p.560).  On  the 
other  hand,  drift-free  systems  are  typically  GAC  (cf.  §5  for  an  example). 

This  motivates  our  study  of  the  more  general  situation  where  the  given 
control-affine  system  x  =  h(x)  +  G(x)u  is  GAC,  but  not  necessarily  C°- 
stabilizable.  We  wish  to  design  a  feedback  K  so  that  the  closed-loop  system 

x  =  h(x)  +  G{x){I\{  x)  +  u)  (9) 

is  ISS.  In  fact,  we  will  design  our  feedback  for  (9)  so  that  the  more  general 
closed-loop  system 


x  =  h(x)  +  G(x)(K(x  +  e)  +  u)  (10) 

is  ISS  with  respect  to  the  actuator  error  u  when  the  observation  error  e  is 
sufficiently  small  (cf.  definitions  below).  In  this  context,  the  precise  values  of 
e(t)  are  unknown  to  the  controller,  but  information  about  upper  bounds  on 
|e(t)|  can  be  used  to  design  the  feedback.  For  the  case  of  continuous  feedbacks 
I\ ,  small  errors  in  the  controller  in  (10)  can  be  tolerated.  However,  if  we  allow 
discontinuous  K,  then  small  observation  errors  can  have  a  substantial  effect  on 
the  dynamics,  in  which  case  the  magnitude  of  e  will  need  to  be  constrained  in 
terms  of  the  frequency  of  the  sampling  (cf.  below  for  the  precise  restrictions  on 
e).  For  a  construction  of  a  stabilizing  feedback  K  for  (10)  under  the  stronger 
assumption  that  the  given  system  is  C°-stabilizable,  see  [25]. 

Since  GAC  systems  are  not  in  general  C°-stabilizable,  we  will  in  fact  need 
to  consider  discontinuous  feedbacks  for  (10),  which  produces  the  technical 
problem  of  defining  precisely  what  is  meant  by  a  solution  for  a  system  that  is 
discontinuous  in  the  state,  since  the  usual  existence  theorems  for  solutions  of 
differential  equations  would  not  apply.  Our  solutions  will  therefore  be  taken  in 
the  more  general  sense  of  sampling  and  Euler  solutions.  By  an  Euler  solution, 
we  mean  a  uniform  limit  of  sampling  solutions,  taken  as  the  frequency  of 
sampling  becomes  infinite.  The  following  definitions  from  [14]  make  these  ideas 
precise. 

We  say  that  ir  =  {t0,  t\,  £2,  •  •  •}  C  [0, 00)  is  a  partition  provided  tQ  =  0, 
ti  <  ti+ 1  for  all  i  >  0,  and  t*  — »  +00  as  i  — >  +00.  The  set  of  all  partitions  is 
denoted  by  Par.  Let  F  :  IR"  x  IRm  x  IRm  — >  IR"  :  ( x,p,u )  1— >  F(x,p,u)  be 
a  continuous  function  which  is  locally  Lipschitz  in  x  uniformly  on  compact 
subsets  of  IR"  x  IRm  x  IRm.  Recall  that  a  feedback  (for  F)  is  defined  to  be  any 
locally  bounded  function  K  :  IR"  — >  ]Rm  for  which  AT(0)  =  0.  In  particular, 
we  allow  discontinuous  feedbacks.  The  arguments  x,  p ,  and  u  in  F  represent 
the  state,  feedback  value,  and  actuator  error,  respectively. 

We  set  O  :=  {e  :  [0,oo)  — >  IR"}  and  sup(e)  :=  sup{|e(t)|  :  t  >  0}  for  all 
e  £  O,  and  Ov  :=  {e  £  O  :  sup(e)  <  77}  for  each  77  >  0.  Given  a  feedback 
I\  :  IR"  — >  JRm,  an  initial  value  x0  £  IR",  a  partition  7r  =  {tQ,  ti,t2,  ■  ■  •}  £  Par, 
e  £  O,  and  u  £  A4m,  the  sampling  solution  for  the  initial  value  problem 
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x(t)  =  F(x(t),  K(x(t)  +  e(t)),u(t))  (11) 

x(0)  =  x0  (12) 

is  the  continuous  function  defined  by  recursively  solving 

x(t)  =  F(x(t),K(x(ti)  +  e(ti)),u(t)) 

from  the  initial  time  t,;  up  until  time 

Si  =  U  V  sup{s  G  [ti,U+ 1]  :  x(-)  is  defined  on  [t,,s)}, 

where  x(0)  =  xa  (cf.  [4,  14]).  The  sampling  solution  of  (11)-(12)  is  defined 
from  time  zero  up  to  the  maximal  time  t  =  inf{sj  :  s,;  <  This  sampling 

solution  will  be  denoted  by  t  t— >  xn(t;  x0,  u,  e)  to  exhibit  its  dependence  on 

7 r  G  Par,  x0  €  JR",  u  G  Mm,  and  e  G  O,  or  simply  by  when  the  dependence 

is  clear  from  the  context.  In  particular,  if  .s,  =  tj+i  for  all  i,  then  i  =  +oo,  so 
in  that  case,  the  sampling  solution  t 1— >  x^{t\  xQ,  u,  e)  is  defined  on  [0,  oo). 

We  also  define  the  upper  diameter  and  lower  diameter  of  a  given  partition 
IT  =  {to,ti,t2,  •  •  •}  G  Par  by 

d(7r)  =  sup(ti+i  -  ti),  d(7r)  =  inf(ti+1  -  U) 
i>o  *>° 

respectively.  We  let  Par(<5)  :=  {77  G  Par  :  d(7r)  <  <5}  for  each  S  >  0.  We  say 
that  a  function  y  :  [0, 00)  — >  JR"  is  an  Euler  solution  of  (11)-(12)  ( robust  to 
small  observation  errors)  for  u  G  A4m  provided  there  are  sequences  7rr  G  Par 
and  er  G  O  such  that 

(a)  d(7rr)  — >  0;  (b)  sup(er)/d(7rr)  — >  0;  and 

(c)  1 1— >  XTT7.(t',x0,u,er)  converges  uniformly  to  y 

as  r  — >  +00.  In  terms  of  sampling  solutions,  we  have  the  following  analog  of 
ISS  from  [14]: 

Definition  1.  We  say  that  (11)  is  ISS  for  sampling  solutions  provided  there 
exist  P  G  ICC  and  7  G  1C ^  satisfying:  For  each  e,  M,  N  >  0  with  0  <  £  <  M, 
there  exist  positive  5  =  S(e,M,N)  and  n  =  n(e,M,N)  such  that  for  each 
7 r  G  Par((5),  xQ  G  MBn,  u  G  Mff,  and  e  G  O  for  which  sup(e)  <  «d(7r), 

\xn(t;x0,u,e) |  <  f3(M,t)  +  j(N)  +  e  (13) 

for  all  t  >  0. 

Notice  that  condition  (13)  holds  in  particular  for  M  =  |x0|  and  N  =  |u|oo- 
Conceptually,  condition  (13)  says  that  the  system  is  ISS,  modulo  small 
overflows,  if  the  sampling  is  done  ‘quickly  enough’  to  satisfy  7 r  G  Par((5), 
but  ‘not  too  quickly’,  as  determined  by  the  additional  requirement  that 
d(7r)  >  (1/k)  sup(e).  Moreover,  if  we  restrict  to  the  case  where  e  =  0,  then  the 
condition  on  d(7r)  in  Definition  1  is  no  longer  needed.  Notice  that  the  bounds 
on  e  are  in  the  supremum,  not  the  essential  supremum. 

We  also  use  the  following  analog  of  Definition  1  for  Euler  solutions: 
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Definition  2.  We  say  that  the  system  (11)  is  ISS  for  Euler  solutions  provided 
there  are  (3  £  ICC,  7  £  satisfying:  If  u  £  A4m  and  xQ  £  IR"  and  1 1— >  x(t) 
is  an  Euler  solution  of  (11)-(12),  then 

\x(t)\  <  0(\xo\,t)  +  7(l«loo)  (14) 


for  all  t  >  0. 

The  following  result  on  control-affine  systems  is  shown  in  [14]: 

Theorem  3.  If  (7)  is  GAC,  then  there  exists  a  feedback  K  for  which  the 
corresponding  closed-loop  system  (10)  is  ISS  for  sampling  and  Euler  solutions. 

The  proof  of  Theorem  3  is  based  on  the  existence  theory  for  semiconcave  CLF’s 
from  [17]- [18] ,  which  we  review  next.  Let  12  C  IR"  be  open.  A  continuous 
function  g  :  i?  — >  1R  is  called  semiconcave  on  C2  provided  for  any  point  x0  £  12, 
there  exist  p,  C  >  0  such  that 

g{x)  +  g{y)  -  2g  <  C\\x  -  y\\2 

for  all  x,  y  £  x0  +  pBn.  The  proximal  superdifferential  (resp.,  proximal  subd¬ 
ifferential)  of  a  function  V  :  f2  — >  1R  at  x  £  12,  which  is  denoted  by  dpV(x) 
(resp.,  dpV(x)),  is  the  set  of  all  C  £  IR"  for  which  there  exist  a,  77  >  0  such  that 
V(y)-V(x)-a\y-x\2  <  {(,y-x)  (resp.,  V(y)-V(x)-cr\y-x\2  >  (C ,V~x)) 
for  all  y  £  x  +  rjBn.  The  limiting  subdifferential  of  a  continuous  function 
V  :  C2  — >  IR  at  x  £  12  is 

„  (/ ,  . _ J  q  £  IR"  :  there  exist  xn  — »  x  and  ) 

L  r  \  qn  G  dpV(xn)  such  that  qn  — >  q.  J 

In  terms  of  proximal  subdifferentials,  a  CLF  is  defined  as  follows  (cf.  [25]): 

Definition  3.  A  control-Lyapunov  function  (CLF)  for  (1)  is  a  continuous, 
positive  definite,  proper  function  V  :  IR"  — >  IR  for  which  there  exist  a  contin¬ 
uous,  positive  definite  function  W  :  IR"  — » IR  and  a  £  Af  satisfying 

VC  £dPV(x),  inf  (C ,  f(x,u))  < -W(x) 

\u\<a(\x\) 


for  all  x  £  IR". 

The  existence  of  continuous  CLF’s  for  GAC  systems  was  established  in  [19]. 
On  the  other  hand,  the  papers  [17]- [18]  establish  the  following  stronger  exis¬ 
tence  result:  If  (1)  is  GAC,  then  there  exists  a  CLF  V  for  (1)  that  is  semicon¬ 
cave  on  IR"  \  {0}  and  a  £  Af  that  satisfy 

\/(£dLV{x),  min  (C ,  f(x,u))  < -V(x)  (15) 
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for  all  x  £  IR".  Theorem  3  follows  from  this  stronger  existence  result  by  first 
taking  an  arbitrary  selection  £(x)  £  8lV(x)  for  x  ^  0,  and  then  using  the 
combined  feedback  I\  =  K\  +  K2l  where  for  each  x  ^  0,  K\(x)  £  a(\x\ )Bm  is 
any  vector  u  satisfying  the  inequality  in  (15)  for  £  =  ((x),  and 


K2(x) 


~V(x) 


(  sgn((C(a:),51(a:)))  \ 

sgn((C(ar),52(a:))) 


\sgn((C(a ’),9m{x)))J 


where  p,  is  the  ith  column  of  the  matrix  G  and 


[  1,  s  >  0 

sgn(s)  =  <  — 1,  s  <  0 
I  0,  s  =  0 


It  then  follows  that  the  closed-loop  system  (10)  is  ISS  for  sampling  and  Euler 
solutions,  using  the  combined  feedback  K  =  K\  +  K2  (with  A" (0)  =  0). 

Here  is  a  sketch  of  the  proof  that  this  combined  feedback  renders  the 
system  ISS  for  sampling  solutions  when  the  observation  error  e  =  0.  (See  [14] 
for  the  proof  of  the  general  case,  and  for  the  proof  that  this  feedback  also  gives 
ISS  for  Euler  solutions.)  Let  M,  N  >  0  be  given,  and  V  be  a  semiconcave  CLF 
for  the  given  dynamics,  as  above.  Define  the  functions  a,  a  £  by 


a(s)  :=  min{s, min{|x|  :  V(x)  >  s}}  a(s)  :=  max{|cc|  :  V(x)  <  s}.  (16) 

Let  x  i— >  ^(x)  be  any  selection  as  above  and  £(0)  £  IR"  be  arbitrary. 

For  each  x  £  IR",  we  can  choose  u  =  ux  £  a{\x\)Bm  that  satisfies  the 
inequality  in  (15)  for  the  given  dynamics.  Set  F(x,p,u)  :=  f(x)  +  G(x)(p+u). 
Choose  S  :=  {x  £  IR"  :  V(x)  <  a-1  (A0}  ancl  £  e  (0,  min{l,  M})  for  which 
(2 e)Bn  C  S.  Set 

Q:={[aoar1{N  +  M)  +  l]Bn}\eBn, 

:=  min  {V(p)  :  p  £  Qe Z2}  ,  A+  :=  max  {V (p)  :  p  £  . 

It  follows  that  S  CQ£.  We  can  then  choose  i  £  (0,e)  for  which 

a  (p+  <  a(p)  +  |  Vp  £  [0,a_1(A/')  +  A+]  (17) 

where  Ce  >  1  is  a  Lipschitz  constant  for  V  on  Qe /2.  Using  local  uniformity 
properties  for  semiconcave  functions  (cf.  [14]),  we  can  find  a,  p  >  0  such  that 

V{y)  -V{x)<  (C (x),y-  x)  +  <r\y  -  x\2  (18) 

for  all  y  £  x  +  pBn  and  x  £  Q£'2.  We  can  then  choose 
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S  =  6(e,M,N)  G  ^0,  16  + A+£+16A+)  such  that  (19) 


\xn(t;xo,u,0)  -  Xi\  <  (20) 

(where  Xi  =  x^ftp,  xa,  u,  0))  and 

HC(xi)  •  (F(xi,K(xi),u(s))  -  f{xn{s))  -  G(x7r(s))[u(s)  +  K(xi)})  ||7i 
<•  Az.  (21) 

—  8 

where  J;  :=  [fj,fi+i],  for  all  u  G  M f  €  [h,h+i],  7r  G  Par(6),  and  all  i  such 
that  Xi  G  Q£/2.  Defining  J(t)  :=  16/(16  +  t)  and 

f3(s,t)  :=  a  (a~1(s)J(t))  ,  )(s)  “Soq^/s),  (22) 

we  can  then  use  the  estimates  (20)-(21)  to  conclude  that  the  sampling  ISS 
estimate  (13)  holds  for  all  x0  G  MBn,  u  G  tt  G  Par((5),  and  e  =  0. 

The  preceding  construction  uses  the  control-affine  structure  of  the  given 
GAC  system  (7)  in  an  essential  way.  In  fact,  it  is  not  difficult  to  construct 
examples  of  fully  nonlinear  GAC  systems  x  =  f(x,  u)  for  which  there  is  no 
feedback  K  rendering  the  closed-loop  system  x  =  f(x,K(x )  +  u)  ISS  for 
sampling  and  Euler  solutions.  One  such  example  was  provided  by  (6),  p.4. 

On  the  other  hand,  it  is  possible  to  extend  Theorem  3  to  fully  nonlinear 
systems  if  we  interpret  ISS  in  terms  of  feedback  equivalence,  as  follows.  In  what 
follows,  we  assume  for  simplicity  that  the  observation  error  in  the  controller 
e  =  0.  Recall  (cf.  [14])  that  if  /  and  /  are  feedback  equivalent,  and  if  K 
and  0  satisfy  the  requirements  of  our  definition  of  feedback  equivalence,  then 
we  also  say  that  x  =  f{x,u)  is  feedback  equivalent  to  (11)  with  the  choice 
F(x,p,  u )  =  f(x,p  +  0{x)u).  We  then  have  the  following  corollary  from  [14]: 

Corollary  2.  The  fully  nonlinear  control  system  (1)  is  GAC  if  and  only  if  it  is 
feedback  equivalent  to  a  system  which  is  ISS  for  sampling  and  Euler  solutions. 

For  a  proof  of  this  corollary,  see  [14]. 


5  Feedback  Stabilization  of  the  Nonholonomic  Integrator 

In  this  section,  we  use  the  feedback  construction  from  §4  to  ISS  stabilize  Brock- 
ett’s  nonholonomic  integrator  control  system.  The  nonholonomic  integrator 
was  introduced  in  [3]  as  an  example  of  a  system  that  cannot  be  stabilized 
using  continuous  state  feedback.  It  is  well-known  that  if  the  state  space  of  a 
system  contains  topological  obstacles  (e.g.,  if  the  state  space  is  IR2  \  (—1,  l)2, 
and  therefore  has  a  topological  obstacle  around  the  origin),  then  it  is  im¬ 
possible  to  stabilize  the  system  using  continuous  state  feedback.  This  follows 
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from  a  theorem  of  Milnor,  which  asserts  that  the  domain  of  attraction  of  an 
asymptotically  stable  vector  field  must  be  diffeomorphic  to  Euclidean  space. 

Brockett’s  example  illustrates  how,  even  if  we  assume  that  the  state  evolves 
in  Euclidean  space,  obstructions  to  continuous  stabilization  may  still  occur. 
These  obstructions  are  not  due  to  the  topology  of  the  state  space,  but  instead 
arise  from  the  form  of  the  control  system.  Such  obstacles  occur  when  it  is 
impossible  to  move  instantly  in  some  directions,  even  though  it  is  possible  to 
move  eventually  in  every  direction;  when  this  is  the  case,  we  call  the  dynamics 
nonholonomic  (cf.  [25]).  This  gives  rise  to  Brockett’s  criterion,  which  was  first 
announced  in  [3].  Brockett’s  criterion  is  a  necessary  condition  for  the  existence 
of  a  continuous  (time-invariant)  feedback  stabilizer  for  (1);  it  requires  that  the 
mapping  (x,  u)  i— >  f(x,  u)  be  open  at  zero.  For  linear  systems  x  =  Ax  +  Bu, 
this  says  rank  [A,  B]  =  n,  which  is  the  Hautus  controllability  condition  at  the 
zero  mode  (cf.  [25]).  The  nonholonomic  integrator  does  not  satisfy  Brockett’s 
criterion,  and  therefore  cannot  be  stabilized  by  continuous  state  feedbacks. 

The  physical  model  for  Brockett’s  example  is  as  follows.  Consider  a  three¬ 
wheeled  shopping  cart  whose  front  wheel  acts  as  a  castor.  The  state  variable  is 
(xi,X2,  9)T ,  where  {x\,x2)T  is  the  midpoint  of  the  rear  axle  of  the  cart,  and  6 
is  the  cart’s  orientation.  The  front  wheel  is  free  to  rotate,  but  there  is  a  “non¬ 
slipping”  constraint  that  (x\,x2)T  must  always  be  parallel  to  (cos(0),  sin(0))T. 
This  gives  the  equations  x\  =  1)1008(6!),  ±2  =  i>isin(0),  and  9  =  v 2,  where 
V\  is  a  ‘drive’  command  and  V2  is  a  steering  command.  Using  a  feedback 
transformation  (cf.  [25],  or  §4.3  in  [24])  brings  the  equations  into  the  form 

±i=Ui,  x2  =  u2,  x3  =  X\U2  -  x2u1,  (23) 


which  is  called  the  nonholonomic  integrator  control  system. 

One  can  show  that  (23)  is  a  GAC  system.  However,  since  Brockett’s  con¬ 
dition  is  not  satisfied  for  (23),  the  system  has  no  continuous  state  feedback 
stabilizer.  While  there  does  not  exist  a  C 1  CLF  for  the  system  (23),  it  is  now 
well-known  that  every  GAC  system  admits  a  continuous  CLF  (see  [19]).  In 
fact,  it  was  shown  in  [16]  that  the  dynamics  (23)  has  the  continuous  CLF 


V(x) 


=  max 


(24) 


which  is  semiconcave  outside  the  cone  x3  =  4(xf  +  x2).  On  the  other  hand,  it 
is  not  difficult  to  show  (cf.  [14])  that  the  system  (23)  also  has  the  CLF 


x\  +  x 


2 

2 


+  xj, 


(25) 


which  is  semiconcave  on  IR3  \  {0}.  This  allows  us  to  apply  the  theory  of  the 
previous  section  to  the  nonholonomic  integrator  with  the  CLF  (25).  To  check 
the  semiconcavity  of  V,  it  suffices  to  verify  that  S(x)  =  —  \x3\\/x\  +  x\  is 
semiconcave  on  IR3  \  {0},  since  C 2  functions  are  semiconcave  and  the  sum  of 
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two  semiconcave  functions  is  semiconcave.  On  the  other  hand,  the  semicon¬ 
cavity  of  S  follows  easily  because  4>{r,s)  =  —  |rs|  =  min{±rs}  is  semiconcave, 
as  a  minimum  of  two  C 2  functions.  The  proof  that  V  is  a  CLF  follows  from  a 
slight  variant  of  the  change  of  coordinate  arguments  used  in  [16]  to  show  that 
(24)  is  a  CLF;  we  leave  the  proof  to  the  reader  as  an  exercise. 

For  the  nonholonomic  integrator  dynamics  and  the  CLF  (25),  the  stabi¬ 
lizing  K  from  §4  is  constructed  as  follows.  The  system  vector  fields  are 

/  1  0\ 

h(x)  =  0,  G(x)  =1  0  1  , 

\-x2  x i ) 

and  we  can  define  £(•)  by  £(0)  =  0  and 

{2(|*3|  -  r(x))  (—x1/r(x),  -x2/r(x),sgn(x3))  +  2x3e3,  x3r(x )  ±  0, 
-2 r(x)  (—xi/r(x),—x2/r(x),  1) ,  x3  =  0, 

2|x3|(0, -l,sgn(x3))  +  2x3e3,  r(x)  =  0 


for  all  x  7^  0,  where  r(x)  :=  \/xf  +  x\  and  e3  =  (0,  0, 1)T.  In  terms  of 

' H(x)(-xi/r(x)  -  x2sgn(x3))  -  2x2;r3  \ 
ji{x)(-x2/r{x)  +  xisgn(x3))  +  2x\X3  ) 

—x\ /r(x)  —  x2 
— x2/r(x )  +  x\ 


b(x)  =  ((x)G(x)  =  <  —2  r(x) 


0 

-21*31 

where  fi(x)  :=  2(|x3|  —  r(x)),  the  stabilizing  feedback  is  then 

b(x) 


K(x)  =  —  V  (x) 


\b(a 


(sgn(6i(x)),sgn(62(x))) 


r{x)x3  ±  0 
x3  =  0 
r(x)  =  0 

(26) 


for  x  yf  0  and  I\( 0)  =  0.  It  follows  that  the  corresponding  closed-loop  system 
x  =  h(x)  +  G(x)(K(x  +  e)  +  u)  is  ISS  for  sampling  and  Euler  solutions,  using 
the  feedback  (26). 


6  Systems  with  Large  Observation  Noise 

In  the  preceding  section,  we  studied  the  problem  of  constructing  a  state  feed¬ 
back  K  such  that  the  closed-loop  system 

x  =  h{x)  +  G{x){K{x  +  e)  +  u)  (27) 

is  ISS  with  respect  to  the  actuator  error  u,  where  e  is  an  observation  noise. 
We  assumed  that  the  given  system  x  =  h(x)  +  G(x)u  was  GAC,  and  we  also 
used  the  fact  that  the  observation  noise  e  in  the  controller  was  sufficiently 
small.  It  is  natural  to  ask  whether  our  analysis  can  be  extended  to  the  case 
where  the  observation  error  e  is  an  arbitrary  bounded  measurable  function. 
More  generally,  one  could  consider  the  following  conjecture  (where  we  use  w 
to  denote  the  input  to  distinguish  it  from  the  actuator  error): 
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Conjecture  L.  If  h  :  IR"  — >  IR"  and  G  :  IR"  — >  IR"XT"  are  locally  Lipschitz 
with  h( 0)  =  0,  and  if  x  =  h(x)  +  G(x)w  is  C°-stabilizable,  then  there  exists 
a  continuous  feedback  K  :  IR"  — >  IRm  satisfying  the  following:  There  exist 
/3  £  ICC  and  71 , 72  €  /Coo  such  that  for  each  initial  value  xa  €  IR"  and  each 
e  €  Mn  and  each  u  £  Mm,  each  solution  x(t)  of  the  closed-loop  system  (27) 
starting  at  x0  satisfies  |x(i)|  <  /3(\x0\,t)  +  7i(|m|oo)  +72(|e|oo)  for  all  t  >  0. 

An  important  difference  between  this  problem  and  the  previous  one  is  that 
the  “small”  observation  noise  e  is  now  allowed  to  be  large,  but  we  have  relaxed 
the  stabilization  objective  to  an  ISS  one.  This  problem  is  of  interest  in  the 
context  of  observer  design.  For  details,  see  [25]. 

It  turns  out  that  Conjecture  L  is  false,  even  if  the  effect  of  actuator  errors 
u  is  ignored.  A  counterexample  to  the  conjecture  for  a  single  input  plant  was 
provided  in  [6].  The  counterexample  is  based  on  the  C'°-stabilizable  system 


x  =  (^1  +  20  ^  — j  xxT^j  0(xTx)  ■ 


-1  0 
0  xTx 


0  (—xTx)  X  + 


0 

1 


,  (28) 


where  x  £  IR2  and  0  is  the  rotation  matrix 


m 


cos  9  —  sin  9 
sin  9  cos  9 


One  can  show  that  there  is  no  continuous  feedback  K  for  this  system  that  can 
satisfy  the  requirements  of  Conjecture  L. 

This  can  be  seen  by  choosing  the  actuator  error  u  =  0  and  expressing  the 
system  in  terms  of  the  variable  z  :=  0(—xTx)x,  and  then  considering  only 
initial  conditions  that  lie  on  the  invariant  set  IR2  :  z±  =  0}.  One  then 

constructs  a  sensor  disturbance  e  with  the  property  that  the  corresponding 
value  for  the  perturbed  state  x(t)  +  e(t)  would  lie  on  S  D  {z 2  <  0}  when 
the  actual  state  x(t)  lies  on  S  0  {z 2  >  0}  (cf.  [6]  for  details).  See  [8]  for 
a  construction  of  continuous  feedback  rendering  x  =  f(x)  +  G(x)K(x  +  e) 
ISS  with  respect  to  e,  which  applies  to  a  restricted  class  of  C°-stabilizable 
single  input  nonlinear  systems  in  lower  triangular  form.  See  also  [7]  for  time- 
varying  feedbacks  that  make  control-affine  systems  ISS  to  observation  errors; 
the  feedbacks  in  [7]  apply  for  scalar  systems,  and  for  systems  that  satisfy  a 
feedback  passivity  property. 


7  Integral-Input-to-State  Stabilization 

In  the  previous  sections,  we  constructed  feedbacks  that  render  systems  ISS  to 
actuator  errors.  A  system  that  is  ISS  exhibits  low  total  energy  or  low  overshoot 
when  excited  by  energy  bounded  or  uniformly  bounded  signals,  respectively. 
While  these  are  highly  desirable  characteristics,  it  is  sometimes  the  case  that 
feedback  design  does  not  render  ISS  behavior,  or  that  a  property  weaker  than 
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ISS  is  verified  in  a  step  in  a  recursive  design.  One  such  weaker  property, 
which  was  introduced  in  [23],  is  integral-input-to-state  stability  (iISS).  The 
iISS  condition  reflects  the  qualitative  property  of  having  small  overshoots 
when  the  disturbances  have  finite  energy.  It  provides  a  nonlinear  analog  of 
“finite  H2  norm”  for  linear  systems,  and  as  such  has  obvious  physical  relevance 
and  significance. 

In  this  section,  we  study  the  integral-input-to-state  stabilizability  of 

x  =  h(x,  d)  +  G(x)u,  (29) 

where  u  £  A4m  is  an  input,  d  £  A4m  is  a  disturbance,  and  the  functions  h  and 
G  are  locally  Lipschitz  with  h( 0,  0)  =  0.  This  includes  control-affine  systems 
with  no  disturbances,  as  a  special  case.  We  wish  to  design  a  state  feedback  k 
for  which  the  closed-loop  system 

x  =  h(x,  d)  +  G(x)k(x ),  (30) 


exhibits  iISS.  This  design  problem  is  related  to  the  problems  in  the  previous 
sections,  because  k  will  be  used  to  mitigate  the  effect  of  the  error  term  d.  We 
will  require  that  k  be  almost  smooth,  i.e. ,  smooth  on  IR™  \  {0}  and  continuous 
on  IR”.  Recall  from  [13]  that  the  iISS  condition  for  (30)  states  that  there  exist 
a„,7€  /Coo  and  (3  €  ICC  such  that  for  each  disturbance  d  £  Mm  and  initial 
value  x0  £  IR™,  each  solution  x(t)  of  (30)  starting  at  x0  satisfies 

a0(\x{t)\)  <  (3(\x0\,t)  +  f  7(|d(s)|)ds 
Jo 

for  all  t  >  0.  As  pointed  out  in  [13,  23],  iISS  is  a  weaker  requirement  than 
ISS;  for  example,  the  scalar  system  x  =  —x  +  xd  is  iISS  but  not  ISS. 

The  feedback  constructions  in  the  preceding  sections  are  based  on  the 
existence  of  CLF’s.  In  parallel  to  those  results,  the  feedback  k  for  (30)  can  be 
constructed  using  an  ilSS-CLF  for  (29),  which  is  defined  as  follows  (cf.  [13]): 

Definition  4.  We  say  that  a  positive  definite  radially  unbounded  smooth  func¬ 
tion  V  :  IR™  — »  IR.  is  an  ilSS-CLF  for  the  system  (29)  provided  there  exist  a 
positive  definite  function  a  :  IR  — >  [0,  oo)  and  a  class  /Coo  function  \  such  that 

inf  {a(x,  d)  +  b[x)u]  <  —  a(|x|)  +  x(|d|)  Vx  £  IR”,  d  £  lRm,  (31) 

itGlR771 


where  a(x,d)  =  \7V(x)h(x,d)  and  b[x)  =  Vk(i)G(s:). 

Our  construction  of  the  feedback  k  is  based  on  the  well-known  ‘universal 
formula’  for  feedback  stabilization,  which  was  introduced  in  [21]  and  later 
generalized  to  p-norm  bounded  controls  in  [15].  We  will  use  the  functions 


h-u  (u,  6) 


a+  yja2  +  |6|4 
\b\2 


b^0 

6=0 


0, 


(32) 


Asymptotic  Controllability  and  Input-to-State  Stabilization 
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and 

uj(x)  :=  max{a(x,  d)  -  x(|d|)} 
d 

where  a(x,  d )  and  \  are  from  the  ilSS-CLF  definition,  and  where  we  assume 
without  loss  of  generality  that  y(r)/r  +oo  as  r  — >  +oo,  which  is  necessary 
for  w  to  be  well-defined.  The  function  Ku  comes  from  the  ‘universal’  stabilizing 
formula  from  [21]  (cf.  Remark  1  for  details).  In  terms  of  the  functions  a  and  b 
from  Definition  4,  we  say  that  an  ilSS-CLF  V  has  the  small  control  property 
(scp)  provided:  for  each  £  >  0,  there  exists  S  >  0  such  that  if  0  <  \x\  <  6, 
then  there  exists  u  with  |u|  <  £  for  which  u>(x)  +  b(x)u  <  —  a(|x|).  We  also 
choose  an  almost  smooth  function  u>  that  satisfies 

u>( x)  +  a(|x|)/3  <  lu(x)  <  lu(x)  +  2o:(|x|)/3  Vx  €  1R", 

where  a  is  the  positive  definite  function  from  the  definition  of  an  ilSS-CLF. 
The  existence  of  u>  is  standard  (cf.  [13]).  In  terms  of  the  functions  we  have 
defined,  we  have  the  following  feedback  construction  shown  in  [13]: 

Theorem  4.  If  V  is  an  ilSS-CLF  for  (29)  satisfying  the  small  control  prop¬ 
erty,  then  the  feedback  k(x)  :=  Ku(u(x),b{x))  is  almost  smooth  and  renders 
the  closed-loop  system  (30)  integral-input-to- state  stable. 

The  proof  of  Theorem  4  is  based  on  the  ilSS-Lyapunov  function  charac¬ 
terizations  from  [1], 

Remark  1.  In  addition  to  the  preceding  construction,  formula  (32)  can  also 
be  used  to  give  an  explicit  expression  for  our  feedback  K  =  Ki  +  K2  from 
§3,  under  the  additional  assumption  that  the  CLF  V  for  the  given  system 
x  =  h(x)  +  G(x)u  satisfies  the  small  control  property  (cf.  [21]).  Indeed,  in  this 
case,  it  suffices  to  use  the  feedback  Ki(x)  =  Ku(a(x),b(x))  and  K2  as  before, 
where  a(x)  =  W(x)h(x)  and  b(x)  =  VV(x)G(x)  are  the  Lie  derivatives  in 
the  direction  of  V.  When  defined  in  this  way,  K;  is  the  so-called  universal 
formula  for  feedback  stabilization  from  [21],  and  is  almost  smooth.  A  similar 
construction  can  be  made  when  the  given  system  is  merely  GAC  (cf.  §4); 
in  this  case,  we  replace  the  Lie  derivatives  a(x )  and  b(x)  in  the  formula  for 
K i  with  a(x )  =  ((x)h(x)  and  b(x)  =  ((x)G(x),  respectively,  for  a  selection 
C(x)  €  8lV( x)  for  the  (possibly  nonsmooth,  but  semiconcave)  CLF. 

Remark  2.  The  novelty  of  Theorem  4  is  that  it  uses  a  universal  formula,  rather 
than  the  more  commonly  used  pointwise  min  norm  control  laws  (which  are 
in  general  just  continuous)  or  partition  of  unity  arguments  (which  are  non¬ 
constructive).  For  extensions  of  Theorem  4  to  systems  with  outputs,  see  [13]. 
The  proof  of  Theorem  4  is  based  on  the  fact  that  the  disturbance  d  and  the 
input  u  in  (29)  are  decoupled.  This  allows  the  interchange  of  the  order  of 
the  max  from  the  definition  of  to  and  the  inf  in  the  decay  condition  (31)  (cf. 
[13],  §5).  Consequently,  the  proof  breaks  down  for  systems  where  u  and  d  are 
coupled.  The  search  for  extensions  of  the  theorem  to  more  general  systems  is 
an  important  question  that  is  of  considerable  ongoing  research  interest. 
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